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BACKGROUND OF THE INVENTION 
TECHNICAL FIELD OF THE INVENTION 

The present invention relates generally to work product evaluation, and more 
particularly, to a method and system of reviewing and evaluating the written work 
product of financial advisors. 

DESCRIPTION OF RELATED ART 

Financial advisors are often hired to provide a variety of financial advice to a 
variety of entities, such as individuals, trusts, and corporations. The advice given may 



916931.1 



1 



Express Mail No.. EL608986665US 



include advice concerning how to invest money, how to plan for retirement or college 
education of children, how much money to save, and how to save money. Some 
financial advisors may provide adequate advice to their customers, but other financial 
advisors may not be as successful. However, in certain circumstances, it may be 
difficult to determine whether a financial advisor is providing insufficient work-product or 
superior work-product. This problem may be exacerbated in an organization in that a 
supervisor may have the difficult task of evaluating several financial advisors. In 
addition, there may be several supervisors, each with different expectations regarding 
the appropriate advice. 

In the past, there were a few methods for evaluating a financial advisor. 
However, these methods suffered from a variety of drawbacks. Among these methods 
are the evaluation of feedback from clients, such as the number of complaints or "Thank 
you" letters submitted regarding a particular advisor. In addition, a supervisor of a 
group of financial advisors may also compare the work of his subordinates to the 
supervisor's own work product. However, different supervisors may have their own 
standards of what qualifies as acceptable work product. 

It would be beneficial to have a method for evaluating the performance of an 
advisor. It would also be beneficial for financial advisors in general, and a group of 
financial advisors in particular, to have a set standard by which their work is measured. 
In that regard, not only is each individual advisor evaluated, but the group as a whole 
may also be evaluated to improve the service provided by the group of financial 
advisors. In addition, such a set standard would also be useful for individual advisors, 
as they would be able to determine if their work product meets the needs of their clients. 

SUMMARY OF THE INVENTION 
The present invention discloses a multi-step system and method for gathering, 
evaluating, and scoring written advice provided by financial advisors to their clients. 
The process allows a company to provide meaningful data regarding the advice across 
a market group and provide distinctive differences between different areas of financial 
planning as well as distinct differences between different groups of financial advisors. 
The system also allows a company to monitor whether the quality Level of advice 
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provided by the financial advisors over a predetermined period of time is static, 
increasing, or decreasing. 

The present invention involves the evaluation of written work-product prepared 
by a financial advisor. In one embodiment of the invention, the work-product is read, 
5 then rated by comparing the work-product to a standard that is established beforehand. 
Thereafter, the case is assigned a numerical value that is based on the above 
comparison. There may be more than one piece of work-product of each financial 
advisor being reviewed. In addition, the evaluation process may be carried out in a 
manner such that each piece of work product is evaluated by different people. In 
10 addition, more than one piece of work product may be selected for review. 

The rating method being used may be a numerical rating using integers from 1 to 
5, in which a higher number indicates higher compliance with the standard. An 
3 exemplary rating system may equate a rating of 1 with questionable work product; a 
^! rating of 2 to limited work product; a rating of 3 to reasonably informative work product; 
Mis a rating of 4 to reasonably detailed work product; and a rating of 5 to outstanding work 
(It product. 

W jhe work product may be evaluated in a number of different areas, such as 

H Financial Planning; Financial Position; Protection Planning; Disability; Life Insurance; 

n Long-Term Care; Investment Planning; Tax Planning; Retirement Planning; Estate 
Planning; Communication; and Overall rating. 

□ An alternative listing of areas in which work product may be rated includes the 

following: Cash reserves; Budget/Expenses/Cash Flow/Debt Management; Overall 
Financial Position rating; Disability Insurance; Affordability of Disability Insurance 
Recommendation; Feasibility of Goal Achievement regarding Disability Insurance 
25 recommendation; Overall rating of Disability Insurance section; Affordability of Life 
Insurance Recommendation; Feasibility of Goal Achievement regarding Life Insurance 
recommendation; Overall rating of Life Insurance section; Affordability of Long-Term 
Care Recommendation; Feasibility of Goal Achievement regarding Long-Term Care 
Recommendation; Overall rating of Long-term Care section; Affordability of Investment 
30 Planning Recommendation; Documentation of risk tolerance of the client; Exploration of 
tax ramifications of Investment Planning recommendation; Feasibility of Goal 
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Achievement regarding investment planning recommendation; Overall rating of 
Investment Planning section; Advice with respect to Tax-qualified investments; Advice 
with respect to Tax-deferred investments; Advice with respect to Tax-exempt 
investment; Advice regarding tax effect of liquidating certain investments; Advice 
regarding the hiring of a tax advisor; Overall rating of Tax Planning section; Affordability 
of Retirement Planning Recommendation; Documentation of risk tolerance regarding 
Retirement Planning; Exploration of tax ramifications of Retirement Planning 
Recommendation; Feasibility of Goal Achievement regarding Retirement Planning 
Recommendation; Overall rating of Retirement Planning section; Advice regarding wills, 
trusts, or other estate planning techniques; Advice regarding beneficiary designations 
and/or ownership issues; Advice regarding Estate Tax situation; Advice regarding the 
hiring of an estate planning attorney; Overall rating of Estate Planning section; Linkage 
of various financial planning areas to another; Organization and presentation; Statement 
of sources of information and/or assumptions; and Overall rating of the work-product. 

In the event that two different raters (or assessors) rate a piece of work product 
differently, an embodiment of the present invention provides for an additional assessor 
(called an arbitrator) to further evaluate the work product and finalizing a rating based 
on the evaluation of the arbitrator. 

In one 

BRIEF DESCRIPTION OF THE DRAWINGS 
The present invention is illustrated by way of example, and not limitation, in the 
accompanying figures, in which like reference numbers indicate similar elements, and in 
which: 

Figure 1 is a flowchart illustrating the steps performed in evaluating a financial 
advisor in an exemplary embodiment of the present invention; and, 

Figure 2 is a flowchart illustrating the steps performed by an assessor in 
evaluating a financial advisor in an exemplary embodiment of the present invention. 
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DETAILED DESCRIPTION OF EXEMPLARY EMBODIMENTS 
A typical scenario involves a client that hires a financial advisor to obtain financial 
advice. For example, a person may hire a financial advisor to determine how to 
properly invest for his retirement, or to ask for advice as to how much to spend on a 
5 house. After conducting an interview with the client or otherwise obtaining information 
that the advisor believes will be relevant, the financial advisor may provide written work- 
product, often called a "case", detailing the recommendations for the client. This advice 
may include general financial advice or may include more specific advice relating to the 
client's stated goals. Ideally, the information presented is specifically tailored for the 
10 client and lists, in detail, recommended actions and presents the reasons for the 
recommendations. 

The present invention provides a method through which "cases" are rated. It also 
S provides a method with which to rate the work of a group of advisors. Figure 1 
~y s presents a flowchart illustrating a broad overview of exemplary steps of an exemplary 
Mis rating process in accordance with the present invention. A first case of a particular 
J financial advisor is selected (step 102). The selection may be random, chronological 
W (e.g., the most recently prepared case of the advisor may be selected), or it may be 
\* selected in any another manner. The assessor reviews the case (step 104) and 
p= evaluates the case. Optionally, a second case of the financial advisor is chosen (step 
ffho 106) and the assessor reviews and evaluates the second case also (step 108). The 
S second selection may occur simultaneously with the selection of the first case, or the 
second selection may be made after the assessor has evaluated the first case. After all 
reviews are completed, the assessors compile their evaluations of the cases (step 110), 
described in more detail below. 
25 Figure 2 details exemplary steps performed by an assessor in reviewing, rating, 

and evaluating a case. The assessor reads the case (step 202) and rates it in multiple 
categories (step 204), then the assessor assigns an overall rating to the case based on 
the quality of the advice in each category (step 206). One such rating may be a 
numeric rating, on a scale that ranges from, for example, a low of one to a high of five, 
30 using integers. Alternatively, any graphical, symbolic, character or other indicator may 
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be used. In an exemplary embodiment, the scale of one to five is configured generally 
as follows: 

1 ) the advice is considered questionable; 

2) the advice is considered limited; 

5 3) the advice sufficiently answers the question "what to do" and may be 

considered basic advice; 

4) the advice, in addition to providing all the characteristics of Level three 
advice, also details the reasons for a client to take a particular action and how it should 
be done; and 

10 5) the advice is considered outstanding; it has all the characteristics of Level 

four advice, and also provides an analysis of alternative courses of actions. Advice 
receiving a rating of 5 is considered superior to Level 4 advice because it provides 
J{ unique advice or creative solutions tailored to the client's situations. 
^ More specifically, with respect to Level 1, namely, advice is questionable, an 

Mi 5 assessor may wish to have a discussion with the advisor to determine the reasons for 
S the particular advice. For example, the case may advise a client to place $500 per 
W month into an SEP-IRA in order to save for the education of his child. This advice is 
M= questionable for the failure to provide any reasoning or details as to the advice. The 
yf assessor may wish to speak with the advisor to determine the reasons for the 
mo recommendations. 

□ Level 2 advice may not adequately answer the question "what to do?" or the 

recommendations may be inconsistent with the analysis. An example of an inconsistent 
recommendation occurs when the analysis provides that a client requires $1000 per 
month in disability insurance to adequately protect herself and her family. However, the 

25 recommendations may be that the client procure disability insurance of $500 per month, 
without giving any reasons as to the discrepancy. An example of the failure to answer 
the "what to do" question would be a statement such as "invest for growth and income," 
or "utilize your discretionary income towards your goals," that fails to give clients the 
specifics needed to carry out the advice. 

30 Level 3 advice answers the question "what to do?", namely, clear, thorough, 

objective or specific advice begins to appear in the documentation. Furthermore, the 
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advice is reasonable and actionable in that the client is able to follow the advice to 
reach her goals. An example of advice that satisfies the Level 3 standard of this 
embodiment would be, "invest excess discretionary income in mutual funds to help fund 
your education goal," or "prepare a 30-day diary of your expenses to help manage your 
5 cash flow." 

Level 4 advice provides further details as to the reasoning for the 
recommendations and the manner in which the recommendations may be implemented. 
The advice may answer the question of who should be carrying out the 
recommendations and when the recommendations should be implemented. 
10 Furthermore, clear, thorough, specific advice is more evident in the case. An example 
of advice that may be considered Level 4 advice is the following: "John, consider 
investing $500 of your monthly discretionary income into the AXP Blue Chip Advantage 
Fund for Mary's education goal." 
jj In order to improve Level 3 advice such that it becomes Level 4 advice, the 

W5 advisor may wish to add more details. For example, assume that the given advice was 
57; "prepare a 30-day diary of all expenses. Include miscellaneous expenses and average 
W annual bills to create a monthly expense." The reason that the above advice is not 
considered Level 4 is that the advice provides no details as to what the clients should 
Ji[ do once they prepare the 30-day expense diary. Furthermore, the clients are given no 
ffho reasons as to why they should prepare an expense diary. 

5 An exemplary version of the advice given above that meets the criteria for Level 

4 advice is as follows: 

Prepare a 30-day diary of all expenses. Include 
miscellaneous expenses and average annual bills to create a 
25 monthly expense. Once you have confirmed that your discretionary 

income is the $1,000/month and you feel comfortable allocating that 
amount towards your goals, consider the following allocation: 

Invest $200/month into an American Express Cash 
Management fund to help build your cash reserves (refer to the 
30 cash reserve section for additional details). 

Invest $500/month into a Retirement Advisor Variable 
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Annuity to help supplement your retirement savings (refer to the 
retirement and asset management sections for specific details 
regarding this contribution). 

Invest $300/month into the American Express New 
Dimensions fund to help start the savings program for Johnny's 
college education fund (refer to Johnny's education scenario for 
specifics). 



The above advice meets the criteria for Level 4 advice because reasons were 
given for the preparation of a 30-day diary of expenses. In addition, the advice was 
10 provided with information as to the actions to be taken after the diary has been 
completed. 

Another sample of Level 4 work is as follows: 



Sam and Susan consider allocating your committed discretionary income of 
$1,000 per 

month and your "found" money towards the following goals: 



Cash Inflows: 



Discretionary Income 

"Found" Money from adjusting tax withholdings 



$1,000 
$500 



TOTAL Inflow: 



$1,500 



Cash Outflows: 



Allocate dollars into an American Express Cash Reserve Certificate 



25 



to fund your cash reserve goal (see cash reserve section for additional details) 

$200 



Allocate dollars into an American Express Retirement Advisor Annuity 



30 



(See the retirement planning section for additional details) $500 
Establish a monthly savings program to achieve Kim, Kelly, and Karla's 
Education goals (see the education planning section for details) $600 
Purchase a Variable Universal Life policy on Sam's life $200 
(See Sam's premature death section for details) 



TOTAL Outflow: $1 ,500 
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An Advisor can use additional information to improve Level 3 work such that it 
satisfies the criteria of Level 4 work. For example, the advisor should include personal 
information that demonstrates an understanding of the client's situation. This 
information includes the client's name, the names of any children of the client, and the 
5 company's plans and benefits. The advisor should also mention assumptions that are 
used in the analysis and in the proposed strategy, (e.g., although analysis shows that 
the client has $800 per month of discretionary income, the client asserts that he will be 
able to invest $1000 per month.) The advisor should also ensure that the client has 
adequate resources to implement the proposed strategy (e.g., the advisor should not 
10 recommend the investment of $1000 per month when the client has discretionary 
income of $750 per month.) Furthermore, the case should address the connection 
between different areas of a case, in the event that a recommendation impacts another 
J area of the client's situation. 

/■= Level 5 advice, in addition to providing the aspects of Level 4 advice, stands out 

Mis in that the advice may provide options, evaluate the pros and cons of the situations, or 
J provide creative or unique solutions that are tailored to the client's situation. An 
W example of advice that may be considered Level 5 advice follows: 
y, John, based on our discussion regarding your moderately 

% conservative risk tolerance, your timeframe, and your education 

ffk) goal: consider saving $500 of your monthly (small business) 

5 income into your SEP-IRA, investing in the AXP Blue Chip 

Advantage Fund to save for Mary's education. The advantage of 
using your SEP IRA versus an after-tax investment is that you may 
reduce your annual tax liability, the money in the SEP-IRA has tax- 
25 deferred growth, and money saved in qualified retirement plans are 

currently not part of financial aid calculations. The disadvantage of 
using your SEP-IRA is that you will not be eligible to use the funds 
without penalty until you are 59 1 /£ and you may not be in a lower tax 
bracket when you take distributions to pay for Mary's education 
30 costs. Consult with your tax advisor regarding this strategy and the 
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impact of pre-tax savings on your current federal and state income 
tax withholdings. 
The following is another example of Level 5 advice: 
Dear John and Ann: 

The following are the key facts, thoughts and 
recommendations from our meeting of this past Thursday, to the 
best of my notes and recollections. 

1. You have been in the Navy for 14 years, much of that time 
as a carrier administrator on the USS Enterprise. You are currently 
working at Annapolis, but will be going back to the Norfolk, Virginia 
naval base in January-February 2001 upon your reassignment. 

The purpose of our meeting is to reach a consensus 
regarding the magnitude of the new home purchase that you and 
Ann can afford in Norfolk, Virginia, and some general guidelines 
regarding mortgage financing. 

2. You are currently earning about $63,000 annually. Your 
base (about $39,800) is scheduled to increase by 3.5% on January 
1, 2001, while the additional pay component (about $2,600) should 
increase by about $2,100. At 16 years of service, you will be 
eligible for a "time in trade" increase while you will be in line for a 
promotion to full Commander at between 17 and 18 years of 
service. 

3. Upon reassignment to the USS Vincent, you anticipate 
spending the first 1 1 months in a general staff position, then the 
next 15 months in an executive office position with the USS Vincent 
team. Following that, you hope to attend graduate school in 
Charlottsville, Virginia. You are uncertain as to whether you will 
remain in the Navy for a total of 20 years or more. 

4. Ann, you are currently working at the accounting firm of 
Cambridge Associates with an annual salary of about $57,000. 
You are uncertain regarding the details of your qualified retirement 
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plans. Although professionally trained as an accountant, you are 
currently employed as a form of a technology project manager to 
transition the firm to new computers, software, and database 
management. 

5. Upon your move to Virginia, Ann, you stated that you would 
be looking to either continue your foray into the "technology for 
accountancy business" or would be interested in returning to your 
accountant role in the firm. 

6. Based upon our earlier conversations, Ann, you have 
Rheumatoid Arthritis, but the symptoms are currently in remission. 
Your medication costs about $1,200 annually and is covered to a 
significant degree by the Medcorp Group, your health insurance 
program. 

7. You have no children and do not anticipate having any in the 
near future. In the long term, the matter of children is an unknown 
matter. 

8. You own a home in Manassas, Virginia which is currently 
renting for about $1,350 per month. The principle, interest, taxes, 
and insurance (PITI) is about $1,125 per month. Combined with 
the depreciation allowance, tax write-off amounts to about $7,450 
annually. Thus, you are not "out of pocket" to a significant degree. 
Your tenant takes very good care of the property and the mortgage 
debt was recently refinanced. You manage the property yourself. 

9. You purchased the property for about $119,000 and 
estimate its market value at between $143,000 and $155,000. It 
has a prime location, about a mile from the National Battlefield and 
the major highway. 

10. Both of your cars are paid off and in a good state of repair. 
There is about $1,700 remaining on a student loan of Ann's from 
Pennsylvania and disputed tax lien with the state of Maryland. 
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11. You pay state income tax currently in Maryland, but will not 
be paying state income tax in Virginia. 

1 2. Your cash reserves consist of about $3, 1 00 in the household 
bank accounts and about $1,800 in a money market account at 
Fidelity. 

13. You have been investing about $125 per month into six other 
Fidelity accounts, currently values in the $75,000 range. 

14. You are interested in purchasing a home in Norfolk, Virginia 
upon your reassignment. A 1200-1400 square foot home can run 
about $260,000 due to the price of land. You have a bid on a 
house in Norfolk for $405,000, subject to visual inspection by both 
of you, which will occur this week. The Realtor that you are 
working with is married to a mortgage broker. She has suggested a 
loan involving 20% down. 

15. We have discussed at great length the likely limits of you 
loan qualifications, utilizing both our mutual experiences as well as 
the general guidance provided by my Home Affordability Guide. 

I suggest that you consult with your tax advisor on the 
following assumptions and recommendations. 

Assuming a pre-tax equivalent annual income of about 
$130,000, and a non-conforming loan interest rate, it would appear 
that $405,000 is very likely the outermost limit for the price of a 
home you can afford. While you could probably scrape together 
the resources to make a 20% down payment, all of your liquidity 
would be drained. As noted above, you were not clear regarding 
thew level of resources within Ann's retirement plans that might be 
available to aid in the financing of the new home purchase. Further 
stressing the situation is the need for Ann to locate a new job; while 
very employable, she might want to search around for the right 
position at the right salary and that may not be immediately 
available. Also, while the Manassas property is currently leased to 
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a very solid tenant, that situation could change and you might be 
facing the need to carry the property while having to engage a real 
estate services firm to re-lease the property and perhaps manage 
it. 

Of course, you might consider selling that property and 
releasing the equity to enhance your cash resources, net of the tax 
due on the taxable gain. 

Now it should be noted that you thought your monthly living 
expenses above your current rental payment ($2,250 per month) to 
be about $2,000. However, they likely are more even if we assume 
35% of gross earnings (about $3,800) goes to taxes and another 
goes to investment accounts like Fidelity funds and Ann's 
retirement plans. It may be, however, that the additional current 
spending is discretionary and could be turned to meeting the larger 
monthly housing outlay, a large proportion of which would become 
deductible, by the way. Thus, you likely would be able to rebuild 
your liquidity cushion within a few years assuming disciplined 
savings and no sustained break in your earnings streams. It would 
seem to be very important for the two of you to sit down in the very 
near future to review your spending details. At that time, determine 
the component that is properly committed, the amount that is 
discretionary but necessary and the amount which is wholly 
discretionary and available for savings if you only make the choice. 

I remain uncomfortable with the idea of your draining all of 
your liquidity to reach the 20% down payment level, particularly if 
the house you are buying is not the house that you would expect to 
retire to. I encourage you to explore further your financing options 
including 80/10/10 loans (i.e., use of a second trust balloon loan to 
avoid the PMI requirement), a less expensive property and/or 
simply going with a 90/10 loan. As to the interest rate program, 
your mortgage banker is better positioned to advise you, but I am 
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leery about paying much in the way of points until you are clearer 
regarding your time horizon in the property. Obviously, paying 
points involves cash resources, which may already be stretched 
depending on the level of down payment. 



5 



In short, everything seems to be working for now. I am 
concerned that you may be stretched too far if everything stops 
working as well. 



10 



I believe that the above summarizes the key conclusions and 
recommendations from Thursday's meeting. You seemed to be in 
agreement with me when you left If I can be of further assistance 
to you and Ann as you move forward, please do not hesitate to call. 



For the above description of exemplary Levels of advice, an organization or an 
S individual may set a minimum standard. For example, an organization may decide that 
M cases should be Level 3 or above. If a case receives a rating of Level 1 or Level 2, the 
Hi 5 advisor that wrote the case may be advised of the shortcomings and reminded of the 
f standards to which the advisor is being held. Another organization using the above 
W exemplary Levels of advice may decide that the advisors in the organization should 
Mb strive to produce work-product that is Level 4 or above. In a similar manner, an 
JiJ organization using a different rating scale may set a minimum score in a number of 
fffeo different manners. 

S An exemplary embodiment of the present invention additionally or alternatively 

involves the rating of each case in 37 different areas. These 37 areas are grouped 
according to the following outline: 



Financial Planning 



25 



A. 



Financial Position 



B. 



Protection Planning 
1) Disability 



2) Life Insurance 

3) Long-Term Care 



30 



C. 



D. 



Investment Planning 
Tax Planning 



916931.1 



14 



Express Mail No.: EL608986665US 



E. Retirement Planning 

F. Estate Planning 

II. Communication 

III. Overall 

5 More particularly, the 37 different areas being used may be configured as 



follows: 

Financial Planning 

Financial Position 

1 . Cash reserves 
io 2. Budget/Expenses/Cash Flow/Debt Management 

3. Overall Financial Position rating 
Protection Planning 
J Disability Insurance 

M 4. Affordability of Disability Insurance Recommendation 

Mi 5 5. Feasibility of Goal Achievement regarding Disability Insurance 

^ recommendation 

W 6. Overall rating of Disability Insurance section 

M 1 Life Insurance 

Ji: 7. Affordability of Life Insurance Recommendation 

y Uo 8. Feasibility of Goal Achievement regarding Life Insurance 

O recommendation 

9. Overall rating of Life Insurance section 
Long-Term Care 

1 0. Affordability of Long-Term Care Recommendation 

25 11. Feasibility of Goal Achievement regarding Long-Term Care 

Recommendation 

12. Overall rating of Long-term Care section 
Investment Planning 

13. Affordability of Investment Planning Recommendation 
30 1 4. Documentation of risk tolerance of the client 
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1 5. Exploration of tax ramifications of Investment Planning 
recommendation 

16. Feasibility of Goal Achievement regarding investment planning 
recommendation 

5 17. Overall rating of Investment Planning section 

Tax Planning 

1 8. Advice with respect to Tax-qualified investments 

1 9. Advice with respect to Tax-deferred investments 

20. Advice with respect to Tax-exempt investment 

io 21 . Advice regarding tax effect of liquidating certain investments 

22. Advice regarding the hiring of a tax advisor 

23. Overall rating of Tax Planning section 
'% Retirement Planning 

^ 24. Affordability of Retirement Planning Recommendation 

Mi 5 25. Documentation of risk tolerance regarding Retirement Planning 

J 26. Exploration of tax ramifications of Retirement Planning 

W Recommendation 

L 27. Feasibility of Goal Achievement regarding Retirement Planning 

p- Recommendation 

mo 28. Overall rating of Retirement Planning section 

O Estate Planning 

29. Advice regarding wills, trusts, or other estate planning techniques 

30. Advice regarding beneficiary designations and/or ownership issues 

31 . Advice regarding Estate Tax situation 

25 32. Advice regarding the hiring of an estate planning attorney 

33. Overall rating of Estate Planning section 
Communication 

34. Linkage of various financial planning areas to another 

35. Organization and presentation 

30 36. Statement of sources of information and/or assumptions 

Overall 
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37. Overall rating of the work-product 
The overall rating may not be an average of the other ratings, but may instead be 
the assessor's overall feel for the quality of the product, in view of the client's needs. 
For example, if a client specifically requests Protection Planning advice, an assessor 

5 may take that fact into consideration by, for example, basing the overall score on the 
quality of the Protection Planning advice and giving less weight to the rating for the 
Estate Planning advice. 

In the alternative, if a particular case is tailored such that no Estate Planning 
advice was asked for and none was given, no rating is needed for that category and the 

10 lack of Estate Planning advice has no effect on the rating in the Overall category. Thus, 
a case is not penalized merely because no mention is made, for example, of Estate 
Plannning advice. However, if a client specifically asks for Estate Planning advice and 
none is given, that fact should be reflected in the evaluation: preferably, a record is 
made of what advice a particular client is requesting. Ideally, the case reflects the areas 

15 of interest of the client by providing, in an overview or executive summary section, a 
description of why the client is seeking advice. It should be understood that the above 
listing of categories is merely exemplary and different categories may also be used. In 
addition, it should be understood that any number of categories can be used. 

The evaluation process from an organization point of view may be configured in a 

20 number of different manners. In one embodiment of the present invention that may be 
used by a group of financial advisors, each advisor may have two of their cases 
selected for review. Such a selection of cases may be random, or it may be 
chronological (e.g., the most recently prepared case of the advisor may be selected), or 
it may be selected in another manner. In the alternative, instead of having all of the 

25 advisors in a group being evaluated, a portion of the group may be evaluated. This 
may occur if the organization uses a periodic cycle of reviews such that a portion of 
advisors are reviewed during each cycle and the cycle occurs, for example, twice a 
year. In that case, those who were reviewed in one cycle of reviews will be less likely to 
be reviewed in the next cycle of reviews. 

30 All of the cases that were selected for evaluation are then presented to a group 

of assessors. The cases may be randomly assigned to the assessors. In the 
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alternative, the cases may be assigned to the assessors in a predetermined manner, 
such as by specialty of the assessors, alphabetically, or several other manners known 
in the art In either case, the two cases of one advisor may or may not be reviewed by 
the same assessor. The random assignment of assessors to advisors may aid in the 
5 impartial review of the cases. However, it should be noted that, in an exemplary 
embodiment, the advisor's identity is unknown to the assessor until the completion of 
the rating procedure. In that manner, concerns as to the impartiality of the assessors 
should be minimized. 

Each case being rated may be independently evaluated by any number of 
10 assessors. In an exemplary embodiment, two assessors evaluate each case of the 
advisors being reviewed. The two cases may or may not have been written by the 
same advisor. In addition, a group of two assessors may or may not review the same 
gg set of cases. In the event that the two assessors reviewing a particular case disagree 
fl with respect to the overall rating to be given to the case, the case may be reviewed by a 
H 5 third assessor or arbitrator. In that event, the final evaluation of the case may be 
Jji decided by the third assessor or arbitrator. 

m The arbitrator may review the case using the same criteria used by the other two 

M assessors. In the event that the arbitrator's overall rating matches the rating of one of 
pi the assessors, the final overall rating of the case is determined to be the that of the 
2Jo assessor. In the, hopefully unlikely, event that the arbitrator's overall rating of the case 
o does not match the rating of either assessor, several events may occur. In one 
embodiment, the case is further evaluated by additional arbitrators, until two scores 
match. In the alternative, the case may be assigned the overall rating assigned by the 
arbitrator. The arbitrator may or may not know the results of the ratings given by the 
25 previous assessors. 

One advantage of using two or more assessors is that an assessor's bias is less 
likely to affect the results of the evaluation process if two assessors review a case. In 
the event that a biased assessor were to give undeservedly low (or high) ratings, the 
use of another assessor and arbitrator will likely prevent any such bias from affecting 
30 the process as a whole. 
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Once the evaluation of an advisor's cases is finished, the results of the 
evaluation are compiled. The scores in the various categories may be averaged 
throughout the entire group, thereby presenting an overview of any aspects of the group 
that need to be improved. In addition, the individual advisors whose cases have been 
5 reviewed are given the results of the reviews. If any of an advisor's reviewed cases 
received a rating that is below 3 in any category, that fact is pointed out to the advisor. 
By analyzing the shortcomings of an advisor, it is hoped that the advisor will improve his 
performance in the categories in which he is deficient. 

As illustrated above, this invention provides detailed guidance to the assessors 
10 such that the financial advisors throughout the organization are rated on the same 
scale. In addition, this invention gives to the financial advisors an improved indication of 
what is expected of them when providing a written financial analysis. An advisor, by 
J reviewing the scale on which they are rated, can easily determine what he should be 
^ including in his cases. 

Mi5- Furthermore, this invention allows a single organization, no matter how large, to 

present a uniform Level of advice to the clients by establishing a baseline standard. For 
UJ example, an organization may mandate all cases to be rated 4 or above. Another 
M organization, using the same scale, may require all cases to be at least Level 3 advice. 
*M The present invention has been described above with reference to preferred 

Qffeo embodiments. However, those skilled in the art will recognize that changes and 
5 modifications may be made to an exemplary embodiments without departing from the 
scope of the present invention. For example, cases may be rated on a different scale: 
the cases may be rated by assigning an alphabetic rating, instead of a numeric rating. 
The numeric rating may have a different range, such as from 1 to 10. The rating may 
25 be in descending order, with a rating of Level 1 indicating a high rating, as opposed to 
indicating a low rating. Each case may be reviewed by only one assessor. In the 
alternative, each case may be reviewed by three or more assessors. Each advisor may 
have any number of cases being reviewed by various assessors, varying from one case 
being reviewed to all cases prepared by the advisor being reviewed. The assessors 
30 may also be financial advisors, such that the advisors are providing peer review of 
cases. Indeed, one possible advantage of having other advisors perform the functions 
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of the assessors is that the advisors may become more aware of what is expected of 
them by reviewing cases prepared by their peers. 

In addition, while the invention has been described with respect to financial 
advice, the present invention may also be used to evaluate the work-product of people 
5 in other fields. Furthermore, while the present invention has been described as 
involving steps undertaken by humans, it is possible that the evaluation process may be 
computerized. As will be appreciated by one of ordinary skill in the art, the present 
invention may be embodied as a method, a data processing system, and/or a computer 
program product. Accordingly, the present invention may take the form of an entirely 
10 software embodiment, an entirely hardware embodiment, an embodiment combining 
aspects of both software and hardware, or an embodiment utilizing no computerization 
at all. Moreover, the present invention may be described herein in terms of functional 
block components, screen shots, optional selections and various processing steps. It 
1 should be appreciated that such functional blocks may be realized by any number of 
Ml 5 hardware and/or software components configured to perform the specified functions. 

For example, the present invention may employ various integrated circuit components, 
W e.g., memory elements, processing elements, logic elements, look-up tables, and the 
M: like, which may carry out a variety of functions under the control of one or more 

microprocessors or other control devices. 
5lo Similarly, the software elements of the present invention may be implemented 

S with any programming or scripting language with the various algorithms being 
implemented with any combination of data structures, objects, processes, routines or 
other programming elements. The present invention is described below with reference 
to block diagrams and flowchart illustrations of methods, apparatus (e.g., systems), and 
25 computer program products according to various aspects of the invention. It will be 
understood that each functional block of the block diagrams and the flowchart 
illustrations, and combinations of functional blocks in the block diagrams and flowchart 
illustrations, respectively, can be implemented by computer program instructions. 
These computer program instructions may be loaded onto a general purpose computer, 
30 special purpose computer, or other programmable data processing apparatus to 
produce a machine, such that the instructions which execute on the computer or other 



916931.1 



20 



Express Mail No.: EL608986665US 



programmable data processing apparatus create means for implementing the functions 
specified in the flowchart block or blocks. Further, it should be noted that the present 
invention may employ any number of conventional techniques for data transmission, 
signaling, data processing, network control, and the like. It will be appreciated, that 
many applications of the present invention could be formulated. One skilled in the art 
will appreciate that the network may include any system for exchanging data or 
transacting business, such as the Internet, an intranet, an extranet, WAN, LAN, satellite 
communications, and/or the like. The users may interact with the system via any input 
device such as a keyboard, mouse, kiosk, personal digital assistant, handheld computer 
(e.g., Palm Pilot®), cellular phone and/or the like. 

These and other changes or modifications are intended to be included within the 
scope of the present invention, as expressed in the following claims. 
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